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Fig. 30 (continued -1) 



Evaluate the frequency range f Y produced 

T n 

by the nth-order nonlinear output as 
na 



V 



(J Ij when 
j=1 ( a+b ) 



na 



U h wnen / ^ 
i=0 (a+b) 



na 
(a+b) 

na 



<1 



>1 



(a+b) 

where [ x ] denotes the integer part of x. 
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Whether A/ Q =of) 3018 
Yes^ ~\ No 



Whether part of the specified output 
frequency range [c,d] falls into f Y ? 



3020 



Yes 



N Q= n 



3022 



3016 



Whether [c,d] has completely fallen into t.=f v Uf Y 
■ ' r n T n- 



3024 



7i 



es 



N=n 3027 




SetK n =1. forn=N Q N 



3028 



n 



Calculate 

j exp [-Kw, 1.,+ +w n l n ) Jl U (jw.,) do 

W-| + +w n =w 

numerically at w=27i i/MT, i=0,....M/2, 
fori., =l K n I n =1 K n , and n=N 0 ,...,N 



w 
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Fig. 30 (continued -2) 



Compute 
i c = round 



cMT 


and =round 


dMT 


. 2% J 


. 2JI . 





where round (x) means to take the 
integer nearest to x 



Based on equations 
N 



3032 



K 



n=No( 271 ) 1^=1 n 

f exp [-j( Wl 1 1+ +w n 1 n ) I] U (jw,) do w 

3 .... 9iz . i=1 



i=i c> i c +l j d 



1 n MT 

Compute 

c 0n (I 1" W- h =l K n ,...,l n =1....,K n , n=N Q N, 

using at least square routine. 



3044 



3034 



Design a conventional linear filter H(q" 1 ) to improve the 
above design result within the frequency band [c,d] and 
attenuate the responses over the frequency bands which 
are beyond [c,d]. 



set K n =K n +1, 
for n=N n N 



3036 



Check the frequency domain response 

of the filter K 

N' n n 

y(k)=H(q- 1 )=T T l n ),Ekk-1) 

over the frequency band [c,d] 



3038 



No 



Whether the response, in comparision 
with the specified response Y* (jw), 

is okay? _^-<3040 

Yes 



The design is finished and the discrete 
version of the designed nonlinear system is 

K, 



N 



k n 



y(k)=H(q 1 )=]r £ c Qn (\^ l n ).JIu(k-l.) 
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End 
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Fig. 31 (continued -1) 



Evaluate the frequency range f Y produced 
by the nth-order nonlinear output as 
na 



fy = 

'n 



U Ij when 
i=1 ( a+b > 



(J Ij when 



V (=0 



na 

(a+b) 



na 
(a+b) 

na 

(a+b) 



<1 



>1 



where [ x ] denotes the integer part of x. 





Whether part of the specified output 

frequency range [c.dj falls into f Y ? 

*n 



3120 



Yes 



N Q= n 



3122 



3116 



Whether [c,d] has completely fallen into t,=f v Uf v 

Y T n T n- 

3124 




Yes 



N=n 3127 



Calculate |U|*...*|U (jw)| , the nth-order convolution 



n 



integration on |U (jw)| , numerically to yield 
|Ul*-*|U (j27l i/MT)l , i=0,...,M/2. for n= N Q N. 
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B , Fig. 31 (continued -2) 




Compute 
i c = round 



cMT 



2% 



and =round 



dMT 

27C 



where round (x) means to take the 
integer nearest to x 



3132 



Based on equations 
N 



Y B l^')=I-W ) ^luK.-|u[ l (^) 

n=N 0 ^ 7 W 



is Vc +l d 



Compute 

C n , n=N Q N, 

using at least squares routine under the constraint that 
the results must be positive 



3134 



Select NARX model parametres 

K n . c on('l W« '1= 1 K n 'n= 1 K n^ 

for n=Ng,...,N, under the constraints 

K n K n 



^E-Xlw'i U 



H-1 l n =1 



n=N 0 ,...,N 



and other constraints specified by specific 
design problems 



3136 



Check the frequency domain response 
of the filter N Kp 

y(k)=H(q- 1 )=^ ]T W.JIutk-l.) 

n=N 0 l r 'n= 1 
over the frequency bands beyond [c,d], 

which should, ideally, be negligible 



3138 




Whether. the frequency response 
beyond the band [c,d] is ok? 
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Fig. 31 (continued -3) 



The design is finished and the discrete 
version of the designed nonlinear system is 



N 



K 



n 



y(k)=H(q- 1 )=£ c^L, y.JI^k-L 

n=N o 'r'n= 1 ,_1 



3142 




Design a conventional linear band pass filter 
H ( q~1) to attenuate the responses over the 
frequency bands which are beyond [c.d] 



3144 



Complete the design by constructing a nonlinear 
filter the discrete version of which is 

N K n n 
y(k)=H(q 1 )=£ X C ° n( ' 1 W-JHMk-lj) 

n=N o ,_1 
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>0.05, 



. 2n 
U j — 1 
1 MT 



<0.05 for le (l b+ i J# .„ H 



and l a is an integer such that 



u h — i. 

V MT a 



>0.05, 



. 2n 

D 1 

1 MT 



<0.05 for 1 6 { 0 (^-d) 



(4) The relationship between the bound of the output 
spectrum Y B (w), the coefficients of the NARX model 

K 

y (k > = Zy n <k) 



Z"'Z c on(lir-,l n )nu(k-l..) for n>2 

1 i= 1 i»=l i=l 

Zc 10 (l i )y(k-l l) + |;c 01 (l 1 )u(k-l 1 ) for n = l 

and the specrruin U(jw) is given by 



y*(w) = 



1 " H c io( 1 i) exp (-j wl, 
1 



z — — 



1-1 

1=1 



|U|+-..*|U (jw)| 



exp (-j wl,) 



1 



where 



C n X***X!| c on(li/'*vl n )j/ n = N 0 , — ,N 

are parameters associated with the NARX model parameters 

K»'Co.<V",l B >, l^l,-,^,-,!^!,...,^ for n = N 0 ,..-,N, 
MlH<Mjw)| denotes the n-dimensional convolution 

n 

integration for the magnitude | U(j w)|of the. spectrum 
U(jw), which is defined by 
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l ±HuW|=£-£|u( j w 1 )|...|u[j(w-w 1 -,.-. / -w n . 1 )]!dw 1 ... 



aw 



and N 0 =l when the NARX model involves nonlinear terms 
from order 1 to N . 



10 



15 



20 



25 



Based upon this expression, the structure 
parameters N and N 0 and the NARX model parameters are 
determined as below. 

(i) Evaluate 



i=l 



when 
when 



nb 



(a + b) 
nb 



na 



(a + b) 
na 



<1 
> 1 



±«o (a + b) I (a + b) 

where [ x ] denotes the integer part of x, 
na 



l = 



(a + b) 



+ i 



J i =[na-i (a + b) ,nb-i (a + b)], for i = 0,».,i'-l 

I.. =[o,nb-i*(a + b)] 
for n=l,2,... until a value of n is reached such that 
part of- the specified output frequency range [c,d] 
falls into f^ . This value of n is used as the value 
of No- 
di) Evaluate 

for n=2,3,,.. until a value of n is reached such 
that the frequency range [c,d] falls completely 
within the corresponding f Y . This value of n is 
taken as the value of N . 
(iii) Calculate 

M*-*|u(jw)| 
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10 



15 



20 



to yield 

M*---*|u(j 2;r i/MT)[, for i = 0,---,M/2 

n 

using the algorithm 

j^J^2^J./MT)|=T5 i + (7-l)nT^J B " X, i = 0 # --.^ 
{u (0) , U [ n ( M -1)] = Conv|[£^0) , 0 ( M - 1 )],-*, [9 ( 0 ) ,---,U (M - 1 
5(i) = | Ud [ j ^f( i " ' i = 0 ' 1 '*"' M * 1 

for n = N 0 , •-•,]$, where Conv ( . ) denotes the 

convolution operation and U{.) and U(.) represent 
the intermediate results of this algorithm. 



;iv) Based on the (i d -i c + l) equations 



1 mt J n tr(2^ (n - u n| 1 



U 



'/2£i 
\ MT 



i = i c ,i c + 1, •••,!<. 



("cMTl 

where i c = round — — , i d = round 



cLMT 

l7t 



and round (x) 



means to take the integer nearest to x, use a least 
squares routine to compute 

C a , n = N 0 ,-,N, 

under the constraint that the results must be 
positive, and then select the NARX model parameters 

Kn'^U^^lJ , l x = l,.-,K B ,-,l n =1/-/K n 
for n = N 0 ,-'-,N 

under the constraints on the summation of the 
modulus of the coefficients given by 



n = N 0 ,-,N 



1^1 l n =l 

(v) If necessary, design a classical linear filter, for 
example, a band pass filter which ideally allows the 
frequency response to be unity over the frequency 
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band [c,d] and zero beyond to yield the linear 
frequency characteristic 

_1 

1 " jL^dJ exp (-jwlj 

and therefore determine the parameters associated 
with K x , c^dj) , Otherwise, all of the 

parameters of c 10 ( .) can be taken as zero to yield a 
model having no regression terms associated with the 
output . 

(5) Construct a NARX model as shown in figure (14) using the 
results obtained in the above (iv) and (v) . The 
nonlinear system illustrated in figure 14 comprises a 
nonlinear part 1400 and a linear part 1402. It will be 
appreciated that in figure 14 

I c 0n (v-vl n )nu(k-i i )=X-..|] cjl^-vgnufk-l,) 

i^-i * i=i Mi Mi 1=1 

II, 2. 2 Three Specific Examples 
Example 1 

This example illustrates a further implementation or 
design of a nonlinear system following the above detailed 
procedure . 
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(1) The signal to be processed is given by 

1 sin a t -sin B t 

u(t) = 2M - £ 

In t 

with a = 3.3, /?=1, and M u = 1 . 6 . The frequency spectrum 
U(jw) of the signal is shown in figure 15 indicating 

5 that the real input frequency range is [l,3.3]. The 

requirement for the design is to transfer energy of the 
original signal to the frequency band [c,d] = [5 . 6, 7 . 6] 
with the bound on the output spectrum magnitude 
specified to be Y B *(w) = 1.6 over this frequency band. 

10 (2) Sample u(t) with sampling interval T = 0.01 sec to produce 

v ^ 1 sin akT-sin f3 kT 1 sin 3.3x0.01k-sin 0.01 k 

u(k) = 2M u = 2x1. 6x — x 

2jz kT In 0.01k. 

k = -1999,»-,0,"-,2000 
and perform a , Fast Fourier Transform (FFT) on this 
15 series (M=4000) to compute 

U d (j — l] = U.f j — 1 J 1 = -1999, — , Or- ,2000 

d V J M / d V J 4000 J 

and then to yield 

U j— 1 = d j 1=0. Oiuj j 1 1 = -1999 r ■ v 0 , » v 2000 

V J MT J V J 4000x0.0iy d V J 4000 J 

the result of which, in the nonnegative frequency range, 

20 is shown in figure 16* 

Notice the difference between the real spectrum of 
u(t) in figure 15 and the computed spectrum in figure 
16. The differences are due to the errors caused by the 
25 FFT operation. The design should and will be performed 

based upon the computed spectrum to lead to more 
practical results. 
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(3) Evaluate the frequency range [a,b] of u(t) from the 
computed spectrum giving 

a = 0.6283 b = 3.7699 

(4) Design the system structure and parameters 

5 (i) Determination of N 0 . 

Clearly, the output frequency range contributed by 
. the linear part when the input frequencies are within 

[a, b] = [0.6283, 3.7699] is 

=[a,b] = [0.6283, 3.7699] 

10 The frequency range f Y produced by the second 

order nonlinearity in this case is obtained as 
follows . 

Since n = 2, 



20 



nb 



15 (a+b) 



na 



(a+b) 



2x3.7699 



(3.7699+0.6283) 



2x0.6283 



(3.7699+0.6283) 
1.7143-[ 0.2857 ]=I.7143-0>1 



and 





na 


+ 1 = 


i" = 






_(a+b). 





2x0.6283 
3.7699+0.6283 



+ 1 = [ 0.2857 ] + l = 0+l = l 



So 



i-l 



^ =^=j|Jna-i(a+b) ^Ka+bjpjo^i^a+b)] 



i=0 



=[m / i±j|Jo,r±>-(a+bj =[2x0. 6283, 2x3.769^(Jo, 2x3.7699-(0.6283+3.7699)] 

= [1.2566, 7.5398jJ[0, 3.1416] = [0, 7.5398] 
fy 2 thereby obtained contains part of the specified 
output frequency range [c,d] = [5.6, 7.6]. So, N t 



is 



determined to be N rt = 2 



(ii) Determination of N 
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10 



15 



Evaluating = f^ljf^ f or n=2 yields 
^U=^U^=[0' 7.5398]U[0.6283, 3.7699] = [0, 7.5398] 

To evaluate fj^^LK' calculate f Y) first. In 
this case 



nb 
(a+b) 



na 



L (a+b) 



3x3.7699 



3x0.6283 



(3.7699+0.6283) [ (3.7699+0.6283) 

= 2.5714-[ 0.4286 ]=2.5714-0>1 

+ 1 = [ 0.4286 ] + l = 0 + l = l 



i* = 


na 


+ 1 = 


3x0.6283 




.(a+b). 


3.7699+0.6283 



So 

£, 3 =|Jli =IoU I i =[na,nb](J[0,nb-(a+b)] 

1=0 

= [3x0.6283, 3x3.7699]|J[0, 3x3.7699-(0. 6283 + 3.7699)] 
= [1.8848, 11.3097](J[0, 6.9115] = [0, 11.3097] 
Therefore 

f^^LK =[°' 7.5398]|J[0, H.3097] = .[0 / 11.3097] 

f Y | n<J thereby obtained includes the whole specified 

output frequency range [5.6, 7.6]. N is therefore 
determined to be N = 3. 

(iii) Calculate |o|*~-*|u ( j w)| for n = N 0 =2 and n = N = 3 , 

n 

respectively to yield 
M* ^U(j2?r j/Mlj =|lj* ^0(j3r i/4000x0.0lj i=0,- • >4(XX/2, n=2 and 3 

s v ' v V ^ 

n n 

The results are shown in figure 17. 



20 



(iv) Based on the (i d -i c +l) equations 

Y Br (7r i/2000x0.01) = 1.6 = -^C 2 M*|u(j n i/2000 x 0 . Ol) 
+ ^FC 3 |u|*|0|*|u(j^ i/2000x0.0l) 

with 
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i c = round[cMT/2;r] = round[s .6x4000x0. 01/2 x 7t\ = 36 

i d = round[dMT/2^] = round[7 . 6 x 4000 x 0 . 01/2 x n\ = 48 

use a least squares routine under the constraint of 

nonnegative solutions to compute C 2 and C 3 , that is, 

to determine C 2 and C 3 , under the constraints of 

C 2 > 0 and C 3 >0, to minimises the following 

expression 

X 1.6-^C, |^j^i/2000x0.0l)|--^C3 i/2000x0.0l)| 

The results obtained are 

C 2 =0 and C 3 = 3.8367 

(v) Design, optionally, a linear Butterworth band pass 
filter to attenuate the frequency components beyond 
the frequency band [c, d] = [5.6, 7.6] to yield the 
linear frequency characteristic 

10 _3 (0. 0986-0. 1972q" 2 +0.0986q- 4 ) jy 
1-3 . 9633q~ 1 + 5 . 8 988q" 2 - 3 . 9076q" 3 + 0 . 9721q" 4 
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(5) Construct a NARX model as shown in figure 14 with 

N 0 =2, N = 3 f K 2 =K 3 =1, c 02 (l,l) = 0, c 03 { 1 , 1 , 1 ) = 3 . 8367 , 
that is, 

Z Z-Z^tV-vi.lUKlc-li) =Z£c a2 (l 1/ l 2 )fja(k-l i )+ 

n=H, 1^1 1^=1 i=i l^LL^l i=l 

K, K, K, 3 

ZZZUw^n^-iJ 

1 1 2 

=zz c 02 (i 1 ,i 2 )ri u ( k - i i)+ 

i^h^i i=i 

111 3 

ZZZ ^(^^^^^(k-ij 

1^112=11^1 1=1 

=c^(l,l)u 2 <k-l)+c^(l^ 

and 

l(T 3 (o . 0986-0 . 1972q" 2 +0 . 0986q^) 
1-3 . 9633q _1 +5 . 8988q~ 2 -3 . 9076q" 3 +0 . 9721q^ 
which determines the parameters associated with the NARX 
model parameters K x and c l0 (l x ) , 1^1,-,^. 

■ The output frequency response under the given input is 
shown in figure 18 indicating that the energy has been 
transferred to the specified frequency band [c, d] = [5.6, 7,6] 
with the magnitude of the response below the specified bound 
1.6. 

The frequency response of the above design is examined 
for other input signals below. 



i-Z c io<ii>q' 1 

i.=i 
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In the first case, consider 



2M U 

u(t) = ^ 



(a + b)t 

zcos -cosbt - cosa t 



^(b-a)t^L 2 
where a, b, and M u are defined as above. The frequency 
spectrum of the signal is shown in figure 19. The frequency 
range is clearly the same as that of the signal having the 
spectrum given in figure 15 and the magnitude of the 
spectrum also satisfies the condition that 

|u(jw)|<M u =1.6 

This implies that the frequency response of the designed 
system to this u(t) should in theory also transfer energy 
into the frequency band [c, d] = [5.6, 7.6] with the output 

magnitude frequency response being less than Y B *(w) = 1.6 over 
this frequency band. Figure 20 shows this frequency 
response and indicates that the actual result is consistent 
15 with the theoretical predictions . 



For the second case, u(t) was taken as a random 
process with the frequency spectrum given in figure 21. The 
frequency spectrum is substantially within the frequency 

20 range [l, 3,3] with a magnitude of less than 1.6. Therefore, 
the same conclusion should apply for the output magnitude 
frequency response of the designed system to this random 
input. Figure 22 shows this response and indicates that the 
energy is transferred to a new frequency band of 

25 substantially [5.6, 7.6]. Note that the magnitude of the 
output spectrum over this frequency band is well below the 
specified bound Y B *(w) = 1.6. This is because of the effect of 
the attenuation which is due to antrakernel interference of 
the nonlinear mechanism. 

30 The nonlinear filter which has been designed above can 

be represented by the block diagram shown, in figure 23. This 
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The frequency domain response of the constructed model 
to the sampled series of the input signal is shown in figure 
27. It can be seen that excellent energy attenuation has 
been achieved by the designed system. It will be 

5 appreciated that the input energy in figure 2 6 has been 
spread over the designed frequency band by the nonlinear 
filter. 



Example 3 



10 



This example shows another application of the present 
invention to the attenuation of signal energy over unwanted 
frequency bands using designed nonlinear effects. The 
example also illustrates the effect of the same design on a 
15 different input signal to demonstrate the effectiveness in 
energy attenuarion of the designed system ' in different 
circumstances . 

(1) Design a nonlinear system to attenuate the energy of. the 
signal 

20 u(t) = 2M u ^- Sin a t ~ Sin * * 

with a = 3.3, {3 = 1, and M u =1.6. 

(2) The spectrum of the signal is evaluated by sampling the 
signal with sampling interval T=0.01 sec to produce 

* 1 sin akT-sin /? kT ^ 1 sin 3.3x0. Olk-sin 0.01 k 

u(k) = 2M u - ; = 2x1. 6x— x 

2jt kT Tit 0.01k 

25 k = -1999, — , 0, — ,2000 

and then performing a . Fast Fourier Transform (FFT) on 
the obtained time series. The result of the FFT is the 
same as that shown in figure 16. 
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The selected NARX model parameters satisfy the 
relationships 

K. 

Z|c O i(l 1 )| = 0 = C 1 
i,=i 

Zl^V^H^'M+k** 1 ' 2 ! =|0- 192^ +1-0.1) =0.2928=0, 

3£%Jk^A<h& 1 * 1 \i<mO« 2 > 2 \ H0.676H-0.3 =0.9763=0, 

and the different signs selected for 

c 02 (l,l) and 0^(1,2) 
and for 

c 03 (l,l,l) and 0^(1,2,2) 
are in order to give effect to the intra-kernel and 

inter-kernel interferences, which is to attenuate the 

energy of the input signal. 

The frequency response of the constructed model to the 
input signal specified above is shown in figure 2 8 which 
indicates that the required energy attenuation has been 
realised. 

The frequency response of the design above to the input 
signal in example 2 gives the result shown in figure 29. 
The nonlinear system design above clearly also works for the 
signal in example 2 in energy attenuation although the model 
was not specially designed for this signal. This is 
reasonable since the magnitude of the spectrum of the signal 
in example 2 is less than the magnitude of the spectrum of 
the signal in this example over almost all of the input 
frequency band and over the other frequency bands the 
magnitudes of the spectra of the two signals are all zero. 
This illustrates that the above design is effective not only 
for the input based on which the design is implemented but 
also for other inputs with magnitude frequency 
characteristics less than the magnitude of the spectrum of 
the considered input. 
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III. FLOWCHARTS 

Referring to figure 30, there is shown a flow chart 
3000 depicting the steps of an embodiment of the present 
5 invention in which the output spectrum is specified over a 
given range of output frequencies. 

The signal to be processed and the desired frequency 
response of the non-linear system to be designed are input 
10 via steps 3002 to 3006. 

At step 3002, a digital input signal {u(k)} and its 
sampling interval T are to be provided. The range of output 
frequencies [c,d] over which the energy of the input signal 
15 is to be transformed is given in step 3004. The output 
frequency range is specified using beginning and end 
frequencies c and d respectively. The distribution of the 
energy over the output . frequency range [c,d] is requested or 
specified in step 3006. 

20 

The frequency characteristics of the input signal are 
determined at steps 3008 and 3010. More particularly, the 
frequency components of the digitised input signal, {u (k) } , 
are calculated using a Fast Fourier Transform at step 3008. 
25 The range of frequency components contained within the input 
signal is determined from the FFT at step 3010. 

Referring to steps 3012 to 3024, the orders of the 

nonlinearities required to realise a desired nonlinear 

30 system and, hence, the energy transformation, are 
calculated. 



